It is to my belief,, that this Rutherford was separated from his wife and kid(s) through the latter years of his life.
As I remember JFR was split from his wife, NY winters were too cold for him due to health problems caused by his incarceration.
He had one son, Malcolm, who worked with CTR as his stenographer at one time. He married his wife Pauline and I have seen a photo of them on here with JFR in Hawaii at a convention. After 1942 Malcolm seems to get little mention but Mary Rutherford is mentioned in the Proclaimers Book, I think she died in the 1960's.
George